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(54) Measuring apparatus 

(57) A preferred shape measuring apparatus com- 
prises a characteristic pattern extracting portion (5) for 
calculating, in accordance with a pair of first images (51) 
of a subject (O) for measurement having characteristic 
patterns serving as references provided thereon in dif- 
ferent angles and a pair of second images (52) of the 
subject (O) for measurement having no characteristic 
patterns serving as references provided thereon in the 
same angles as with the first images (51), the difference 
between the first image (51) and the second image (52) 
taken in each direction, thereby obtaining the character- 
istic patterns (54), a positional relationship calculating 
portion (6) for obtaining a positional relationship 
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between the pair of the first images (51) or the pair of 
the second images (52) on the basis of the difference 
images obtained in the characteristic pattern extracting 
portion (5), a stereo model forming portion (7) for mutu- 
ally relating in accordance with the positional relation- 
ship obtained in the positional relationship calculating 
portion (6), the first images (51) or the second images 
(52) so that a stereo model capable of being stereo- 
scopically viewed is formed, and a shape measuring 
portion (8) for obtaining the shape of the subject (O) in 
accordance with the stereo model formed in- the stereo 
model forming portion (7). 
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Description 



BACKGROUND OF THE INVENTION 



TECHNICAL FIELD 

,H~IH e invention 1 re,ates t0 technologies for achieving automation of orientation work at the preceding stage of makina 
threed.mens.onal measurement from different camera positions, automatic acquisition of initial values for^erS 
matching, and automation of the three^limensional measurement. 6 60 

PRIOR ART 

thrn,lnh P ,t?»S three<,i,nenSi0n u al measuremerrt in close-range photogrammetry the measurement is carried out 
through the flow of processes as shown in FIG. 1 . Namely, ft is required to perform processes of taking a pafrof SeSo 
.mages of a subject (a) -+ position detection <b) -> orientation (c) -> stereo mode, formation (d) _ EJH£2Z5 

ISTTS. * ^ °^ 1heSe PrOCeSSBS are P erformed ™** * "P**". of a compute . the pr^al™ 
SSon mf 0 " W *• J™***™"^ »^^ement (e) have so far been performed manual ^e^2t^ 

eTastna^^^ 

By obtaining the relative position between the cameras and the subject in the process of the orientation fcl .t 
becomes posaWe to form a stereo mode, providing a stereo view and achieve the ttree^imensiona. m^Temtt 

IlhT°" J 1 " P0S,, ' 0n deteCti0n (b) P 1 "^" 9 the ° rienta,ion < c > is such work as to <***» coordinate ST™ 
each camera, of six or more corresponding points taken by separate cameras. ^ ' 

in Si! «,T n8i0 ? measurement < e >- there ^ two kinds: point measurement and planar measurement 
In the case of the po.nl measurement the point to be measured on the subject is generally measured manuaiiv 

Se sSSt aUt0matiC meaSUrement fe Plann6d ° r imprWemert ac - r -V ^ desired. H is ^cti^uTa^ 

. '"^ K C3Se 01 ,he planar measurement, automatic measurement is carried out by using a method of stereo match- 

^ae^rZ ^ ,n9 - Jh T^ & '- * was required to make sucn W* setting asdetermina °on ££££ 
image and setting up of the searched width through manual work. 

.H^IT"!!. 0 ! 1,16 position detection (b). the operator selects six or more points of measurement on the subject in 
the left and nght .mages and. while observing each image, correlates the potato of measurement on tne s^St^iS 
2T an l detects the «^inates of the positions. However, since the operator basically raTto dofu^r^ 
while takng a stereo view, it required skill and. in addition, it was complicated, difficult, and problematic 
«, rv Espeaally '' n SL "* work as to correlate the left and right images with each other upon determination of the ooints 
JlZ^ZZ ^ ^ the d6tai,ed «"*-■» * the positions, persona, errors were liable to occu?. 
drfferent from operator to operator, and sufficient accuracy was difficult to obtain. There were even cases Sere *S> 

B „rh H r™ e l? iS ^ unfa ™ rab,e thin 9 tor such work as gluing a mark onto the subject to increase, and there are even 
!!?nS£^;2^ 00 ** SUjjeCtS * 9,Uin9 8 ^ ^ ***** iS V6ry diffteU,t - ^erefore 6 4m^ 
ster^^^ «— " « «* ~ ^ onto a 

can tM^r^rT" "T* Sh0U ' d ab5olute, > r be ™ in the relative position between two cameras on the 

pan Wt head, and therefore the measurement environment and the subject for measurement are greatly limited At the 

^Z'SSSSSl^-^ 0 ^^ heaV * 10 hand ' e ^ -P- Si - He4 £££ 

ontom?!!^" 1 meas "ement in the three-dimensional measurement (e). when a mark or the like is not glued 
^1 I 1 measurement, the operator had to indicate the point of measurement while observing the taken 
.mage ,n the course of the measurement. Therefore, much labor and time were required when there were rSany S 
of measurement. Further, when H was attempted to make precise measurement, personal errors were liable to occur 
and. in the worst case, measurement itself became unachievable 

but in iS/!!? 8 85 2 eSCri S abWe 030 *" obvia,ed ff measurement is carried out after gluing a mark onto a subject 
but in that case, as described above, the labor for attaching the mark was newly required and. depending on the sS 
jects rt was drfficult to g ue a mark onto the subject and sometimes H became impossible to make measurement 
. r^T. 6 ■ P mea surement. it was required to manually make such work as to determine the template 
image and determine an optimum searched width as a preprocess in making automatic measurement through stereo 
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matching. Further, when mismatched points or the like occurred, correction had to be made manually. Thus, it was dif- 
ficult to realize automation. 

SUMMARY OF THE INVENTION 

5 

It is an object of the invention to provide a shape measuring apparatus, an image measuring apparatus, and an 
image forming apparatus capable of performing the processes from the orientation work to the three-dimensional 
measurement automatically, effectively, and precisely. 

A preferred shape measuring apparatus according to the invention comprises a characteristic pattern extracting 

io portion, in accordance with a pair of first images of a subject for measurement having characteristic patterns serving as 
references provided thereon in different angles and a pair of second images of the subject for measurement having no 
characteristic patterns serving as references provided thereon in the same angles as with the first images, for calculat- 
ing the difference between the first image and the second image taken in each direction thereby obtaining the charac- 
teristic patterns, positional relationship calculating portion for obtaining a positional relationship between the pair of the 

is first images or the pair of the second images on the basis of the difference images obtained in the characteristic pattern 
extracting portion, a stereo model forming portion, in accordance with the positional relationship obtained in the posi- 
tional relationship calculating portion, for mutually relating the first images or the second images so that a stereo model 
capable of being stereoscopically viewed is farmed, and a shape measuring portion for obtaining the shape of the sub- 
ject in accordance with the stereo model formed in the stereo model forcing portion. 

20 The characteristic pattern extracting portion can be adapted to extract the characteristic pattern image through 
comparison of the difference image constituted of the difference between the first image and the second image taken 
in each direction with a reference characteristic pattern image previously stored. 

The characteristic pattern extracting portion can be adapted to extract the characteristic pattern image through 
comparison, according to a template matching method, of the difference image constituted of the difference between 

25 the first image and the second image taken in each direction with a reference characteristic pattern image previously 
stored. 

The characteristic pattern extracting portion can be adapted to extract the characteristic pattern image first by mak- 
ing coarse detection according to a template matching method and then making precise detection by applying prede- 
termined processing to an image in the vicinity of a characteristic pattern. 

30 A preferred image forming apparatus for shape measurement according to the invention comprises a characteristic 
pattern forming portion for selectively forming characteristic patterns serving as references on a subject for measure- 
ment and an image forming portion for taking an image of a subject for measurement having characteristic patterns 
serving as references provided thereon in different directions thereby obtaining a pair of first images and taking an 
image of the subject for measurement having no characteristic patterns serving as references provided thereon in the 

35 same directions as with the first images thereby obtaining a pair of second images. 

The characteristic pattern forming portion can be constituted of a characteristic pattern projecting portion for selec- 
tively projecting characteristic patterns serving as references onto a subject for measurement. 

A preferred image measuring apparatus according to the invention comprises an approximate position measuring 
portion for approximately obtaining, from a pair of images of a subject for measurement in different directions, positional 

40 information of the subject for measurement in each of the images, a data setting portion, having one image of the pair 
of images set as a reference image and the other image as a searched image, for setting up, in accordance with the 
positional information obtained in the approximate position measuring portion, reference data blocks in the reference 
image and setting up searched areas in the searched image and searched data blocks in the searched area, and a cor- 
respondence determining portion for obtaining correspondence between the searched data block set up in the 

<s searched area and the reference data block The data setting portion, in accordance with the positional information 
obtained in the approximate position measuring portion, performs at least either setting up of the reference data blocks 
in the reference image or setting up of the searched areas and setting up of the searched data blocks in the searched 
image. 

The pair of images include a characteristic pattern image of which positional information is previously known and 
so the approximate position measuring portion can be adapted, in accordance with the position of the characteristic pat- 
tern image in the reference image and the positional information of the characteristic pattern image in the searched 
image, to approximately obtain the positional information of the subject for measurement in each of the pair of images. 

The data setting portion can be adapted to set up the range of the searched area in the searched image in accord- 
ance with the position of the characteristic pattern image in the searched image. 
55 The data setting portion can be adapted to set up the range of the searched area in the searched image in accord- 
ance with its relationship with the position of the characteristic pattern image and the position of the searched area in 
the searched image or with the position of the characteristic pattern image and the position of the reference data block 
in the reference image. 
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f the searched area in the searched 

larg er wkflh or area according as the ^ Wock in the refer ""^"J*^^ in size. 

The data setting portion can be a °^*~ jn ^ reference image. reference image 

— 

BRIEF DESCRIPTION OF THE DRAWNOS ^ w . ^ W«« - * • 

FIG.Aisablc^diagramsho^^^^^ 

FK3. 9 is an explanatory *aw.ngsiw*flng 

FIG. 10 is an explanatory ^ raw !"^ showing a searched image. 
PIG 11 is an explanatory drawng showing ■ «^ , e . 
PS'. 12 is an explanatory drawing ^^^^ed image. 

tup PREFERRED EMBODIMENTS 
40 DESCRIPTION OF THE PRErcHMc arcomD anying drawings. 

a shape measuring apparatus of the invention. 
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a. TAKING STEREO IMAGES OF SUBJECT , ^ ^ ^ ^ & ^ 

As the characters pattern P™H**« P° be used 
is capable of projecting character*!* patterns 
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FIG. 4 is a block diagram showing details of the characteristic pattern extracting portion 5. 

The image data transferred from the left and right image taking portions 1 and 2 are converted into digital data by 
the A/D converter 15 tn FIG. 3 and transferred to an image memory 51 for characteristic pattern projection of the char- 
acteristic pattern extracting portion 5. 
5 Then, in accordance with instructions from the controller 4. the characteristic pattern projection is stopped and 

images having no characteristic patterns are taken by the left and right image taking portions 1 and 2 and the pertinent 
digital data are sent to an image memory 52 for images having no characteristic patterns of the characteristic pattern 
extracting portion 5. 

When the image transfer to the image memory 51 for characteristic pattern projection and the image memory 52 
io for images having no projected characteristic patterns has been finished, the two images, in accordance with instruc- 
tions from the controller 4. are subjected to difference calculation in an image difference calculator 53. The difference 
image is stored into a characteristic pattern image memory 54. 

As a result the data stored in the characteristic pattern image memory 54 becomes such that has the image infor- 
mation of the subject for measurement 0 erased, i.e.. that contains only the information of the characteristic patterns 20 
is (mark image data). 

b. POSITION DETECTION 

In order to perform the orientation process, detection of the mark image positions provided by the characteristic 
20 pattern projection is carried out. 

The characteristic pattern coordinate positions in the characteristic pattern image memory 54 are detected by a 
characteristic pattern position detecting portion 55. 

Although the characteristic pattern 20 may be of any form provided that it dearly indicates its position, those used 
here are assumed to be such characteristic patterns 20 as shown in FIG. 5 or FIG. 6. Further, the characteristic patterns 
25 can be of any number of individual patterns if h is 6 or above as shown in FIG. 5 or FIG. 6. 

Since there is included, in the characteristic pattern image memory 54. no other information than the mark image 
obtained by the projection of the characteristic patterns, erroneous detection can be prevented from occurring. Further, 
since it is facilitated to have the position detection performed automatically, it is made possible to carry out constantly 
stabilized detection of the coordinates of positions free from personal errors and with precision. 
30 Here, a case where a template matching method is used for coarse position detection of the points and a moment 
method is used for detailed position detection will be described. 

With respect to the template matching method, the sequential similarity detection algorithm (SSDA method) as a 
kind of correlation method will be described, but a normalized correlation method or the like may also be used. In the 
detailed position detection, such a method as LOG (Lapiadan of Gausian) filter method may also be used instead of 
35 the moment method. 

Below will be given description on position detecting processes. 

(Coarse Position Detection) 

40 1. A template image is registered. 

As the template image, a simulation image similar to one of the marks of the projected characteristic patterns 20 
shown in FIG. 5 or FIG. 6 may be produced or any of the actual images may be selected for use. 
2. points satisfying S > R (a, b) are searched for in the entire image (refer to Equation 1). 

The closer to 0 the value R(a. b), the higher is the similarity. As S, a suitable value is previously set. Since, in this 
45 case, other image information than the characteristic patterns is erased, determination is easily made. While the nor- 
malized correlation method may be used for the template matching, the process can he performed faster if the sequen- 
tial similarity detection algorithm is used. 

[Sequential Similarity Detection Algorithm (SSDA Method)] 

so 

The principle drawing of the SSDA method is shown in FIG. 7 and the pertinent equation is shown in Eq. 1 . 
The point at which the residual R (a. b) comes to a minimum is the position of the wanted mark. 

Eq.1 

55 

In making the addition of Eq. 1, if the calculating operation is adapted such that the addition is stopped when the 
value of R(a, b) exceeds the minimum value of the residuals obtained in the past and it is shifted to the next (a, b), faster 
processing can be achieved. 
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3. The mark positions of the projected characteristic patterns of the desired number of marks are determined 
according to such conditions as the value R(a. b) being at a minimum and distances between adjoining mark positions, 
and the same are used as position coordinates. 

(Detailed Position Determination) 

1 . Determination of Searched Area 

A searched area is set up centering around the point determined in the above described coarse position detection. 

2. Determination of Mark Region 

With respect to the searched area, a region where the density is over a threshold value is set as a mark (refer to 
FIG. 8). 

As the threshold value, a suitable value is preset The image is virtually 0 at other portions than the marks because 
it has been subjected to the difference processing. 

3. Calculation of Center of Gravity 

The position coordinate of the center of gravity is calculated according to a moment method. 
[Moment Method] 

The following equations are applied to the points over the threshold value T (the mark K) as shown in FIG. 8. 
Eq 2 
Eq . 3 

By Eq. 2 and Eq. 3. it becomes possible to calculate the position of the center of gravity dawn to the sub-pixel posi- 
tion. 

4. Operations 1 - 3 are performed on each of the total number of the points. 

By performing the above processes, the coordinates of the mark image positions provided by the characteristic pat- 
tern projection as shown in FIG. 5 or FIG. 6 can be calculated. 

It may be possfoie to make the detailed position detection from the beginning without making the coarse position 
detection. Further, any other algorithm than the above may be used for the position detection. 

In any way. since the image is only of the information of the characteristic patterns, it ts possible to calculate posi- 
tions fast and precisely. 

c. ORIENTATION 

Then, the coordinate values obtained in the characteristic pattern position detecting portion 55 are sent to an atti- 
tude calculating portion G, wherein calculation for the orientation work is performed. 

By this calculation, the positions of both the cameras at the left and right and the like can be obtained. 
Those parameters are obtained in accordance with the following coplanar conditional expression: 

Eq. 4 

The origin of the model coordinate system is taken at the center of projection on the left and X-axis is taken along 
the line connecting it to the center of projection on the right. The reduced scale is set by taking the length of the base 
line as the unit length. At this time, the parameters being sought are constituted of the angle of rotation kj around 2- 
axis and the angle of rotation 4> 1 around the Y-axis of the camera on the left and the angle of rotation k 2 around Z-axis, 
the angle of rotation around the Y-axis, and the angle of rotation <oz around X-axis of the camera on the right, five 
angles of rotation in all. In this case, since the angle of rotation around X-axis of the camera on the left is 0. there is 
no need to consider it. 

Under such conditions, the coplanar conditional expression of Eq. 4 becomes as expressed by Eq. 5. By Solving 
this equation, the parameters can be obtained. 

Eq. 5 

Here, between the model coordinate system XYZ and the camera coordinate system xyz, there exist the following 
expressions of relation for coordinate transformation: 
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EQ ' 7 ramete r3 are obtained through the following procedure, 

d. FORMATION OF STEREO MODEL ^ ^ ^ ^ „, ^ 
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Eq. 8 
Eq.9 
Eq. 10 

. t^k^^c^-^*" 8 ''' 

e.THREE-OIMENSlONALMEASUREMENT 



35 



(1) Point Measurement ^ seeding the plurality °* <T 



Bv using the characteristic patterns 20 of si 
JSZS same processes as in the posrt.cn , 
automatically and precisely. 



«, (2)Pl anar Measurement ^.^V**™*"*^*™^^"" 

T.ein.a.va^eslorthestereorna^ngcanbepr^ed^ 

shown in FIG. 6. . , in tne case ot the P ,an * m ^ u '*™™ rt of the projected characterise 

The method to determine the .nfcal values ^ ^ up ^ extract.^ partottn p^ ^ 

With respect to the proiectedcnaracierisncw- searched / 

'p^Sis as image correlation is employed. 

The method to determine the searched area 
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described. 

Taking the section (in the horizontal direction) between the projected characteristic patterns S1 and S2 as a width"! 
A and the section (in the vertical direction) between S1 and S5 as a width B, the portion enclosed by S1 , S2, S5, and 
S6 is set as a searched area R1 . The portion enclosed by S2, S3. S6, and S7 is set as a searched area R2, and, in like 
manner, successive portions encbsed by their respective projected characteristic patterns are set as searched areas. 

The mark images of actually projected characteristic patterns do not always lie on the same line, as shown in FK3. ^\ 
11, depending on the shape of the subject or the orientation of the CCD. Hence, such a rectangle is formed from the 
respective four projected characteristic patterns that has the largest widths A and B and it is set as a searched area. 
For example, in the case of FIG. 1 1. the maximum widths obtainable from S1, S2, S5, and S6 is A1 in the horizontal 
direction and B1 in the vertical direction and the rectangle formed of them is set as the searched area R1 , and, likewise 
the rectangle formed by the largest widths A2 and B2 obtainable from S2, S3, S6, and S7 is set as the searched area 
R2. In this way, although a certain overlapping portion is produced, it is ensured that a search can be made also in the 
boundary portion between the areas R1 and R2. 

The method described above is such that determines the range of the searched area in the searched image in 
accordance with the positions of the mark images in the searched image that are already obtained. \ 

FIG. 1 2 shows an example of variation of the method to determine the searched area. ""^^ 

Since the respective projected characteristic patterns on the left and right images are already obtained as points 
corresponding to each other, an effective search can be made if. for example, the searched area is set up such that the 
search starting point and the search ending point are close to the projected points. Namely, in the example of FIG. 1 1 , 
if the search along the width A1 is carried out successively shifted in the vertical direction from S1 to S5. there is appar- 
ently produced a wasteful searched area (where there is no corresponding point) when the search comes near the line 
passing the pattern S5. 

Hence, down to the position D1 at the halfway point (in the vertical direction) between S1 and S5 of FIG. 12, the 
points at the same position as the point S1 may be taken as the horizontal search starting points in the searched area 
and, between D1 and S5, the line connecting D1 to S5 may be taken as the search starting points in the horizontal 
direction. 

By setting up the searched areas through applying the same processing to each of the projected points and per- 
forming stereo matching with the searched areas overlapping to a certain extent somewhat effective searching can be 
carried out. 

FIG. 13 and FIG. 14 show a case where the search in the searched area is made more effective by setting up 
searched data blocks in a searched area. 

For example, when positions in the searched area corresponding to the reference data blocks T1, T2. 13. ... in 
the reference image shown in FIG. 9 are searched for in a section A1 defined by the marks S1 and S2 in the searched 
image, then, with the searched area divided into some blocks, corresponding searched data blocks U1, U2. U3, . . . 
are set up as shown in FIG. 13. Then, the search in the searched area can be performed quickly and effectively. At this 
time, the range of the searched data block can be determined according to the number of the reference data blocks that 
are set up. When, for example, n reference data blocks are set up in the section A* between the images S'1 and S2 in 
the reference image, the range may be set to A1/n, A1/(n —1), or so. In the case divided by ( n — 1 ), the search is made 
with the searched data blocks overlapping each other to a certain degree. 

The above described method is such that sets up the range of the searched area in the searched image in accord- 
ance with the position of the mark image and the position of the searched area in the searched image that are already 
obtained. Viewed from another angle, it can also be said that the method is such that sets up the range of the searched 
area in the searched image in accordance with its relationship with the position of the mark image and the position of 
the reference data block in the reference image. 

A variation example of the method of FIG. 13 is shown in FIG. 14. This method is such that makes the size of the 
searched data block variable. Namely, the size of the searched data blocks are made smaller in the vicinity of the marks 
Si and S2 because it is known for sure that the corresponding point to the reference data block is located near there 
but, according as the position in question is more distant from there, the size is made larger because the position of the 
corresponding point becomes vague. Accordingly, the searched data block has its largest size at the position corre- 
sponding to the reference data block at the position A72. 

The sizes of these searched data blocks are determined in accordance with the searched area A1 between S1 and 

S2. 

For example, when the number of the reference data blocks in the section A is denoted by n. 
the sizes of the searched data blocks in the section from S1 to SU A1/2 is set to be 

(1+tx i/n) x A1/n. 
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(1 + tx(n-i)/n)xA1/n. 

determination of Reference Data Bocks] ^ ^ ^ ^ ^ ^ ^ 

t.ereferencedatab.^si.esintr.sec.onfrc^S-ltoS^^ are: 



45 
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horizontally. (1+tx i/n)xAVn; 

horizontally. (1 + t x (n _i)/n) x AVn ; 
vertically. (1 + 1 x (m _ 1)/m) * B /m : 
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vertically, ii + » * v" — • . . A _ 
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Thus, the reference data blocks can be made variable. 

Further by making the reference data block with three sizes as shown in FIG. 15 variable as described in the above 

ZZ^^yZZZT hin9 COrre,ati ° n Pr0dUC,S Ca,CUla,ed ' SearCh,n9 ™*»»* witt, 
s The sizes of the reference data blocks may similarly be determined in accordance with the marks S1 and S2 in the 
searched .mage. Then. A' may be replaced with A1 and B' replaced with B1 and. further, a term with the magnification 
A/A1 taken into consideration may be multiplied. u ^ aon 

By following the above described procedure, initial values can be automatically obtained. 
Now, the procedure for carrying out actual measurement (stereo matching) will be described 
10 erwe'toFIGS 8 ^ n 6 ^ * ^racteristic patterns SI - S8 shown in FIG. 6 will be described with refer- 

Since, the orientation processing in the vertical direction is finished and the longitudinal parallax is removed foosi- 
toning is conpleted). it is only required to search along the same line in the reference image and the searched imaoe 
The searched data blocks may be set up in each searched area suitably as described above. 
is 1. Searching for corresponding points along the searched width A1 from S1 to S2 of the horizontal line L1 in the 
searched area R1 of the searched image is performed successively from the reference data blocks T1 T2 « 
the reference image. ' 1 ' * ' 

These initial values are previously determined according to some method described above 
When the search along the width A1 of the line L1 in the searched area R1 is finished. 
so 2. then, searching for corresponding points along the searched width A2 from S2 to S3 of the fine L1 in the 
searched area R2 is performed successively from the positions of the reference data blocks set up in the area 

3. Then, searching for corresponding points along the searched width A3 from S3 to S4 of the line LI in the 
searched area R3 is performed. For the searched area R3. the searching is successively performed from the template 
sizes and positions set up in the area. lempiaie 
When the search for corresponding points along the Pne L1 is finished, then, the searched line is shifted to the next 
line L2 arid searching for corresponding points is performed over again the same as described in the points 1 to 3 above 
starting with the searched width A1 in the searched area R1 . ^° ve 

These searching operations are repeated the number of lines that are necessary 
*nrJSw h Ji e tT 6 des ? ibed »™*edur* the initial values, i.e.. searched areas, searched data blocks, and refer- 
r^t:^ 0 ^;^Z US l m ? e S 5 e0 matching fromthe P^ons °» »>* ejected characteristic patterns can be auto- 
matically determined and automatic measurement becomes possible. 

Further, since the reference data blocks in the reference image can be restricted within A' and B' and searched 
"f*" 1 ,ma 9 e are also restricted, much faster processing than in ordinary stereo matching can be 
ach.eved. Namely, stereo matching is ordinarily performed along one horizontal line in each searched position (refer to 
the processing fame can be reduced to a fraction of the ordinarily required time according to the number of 
in© proj6ct6G points. 

o^rS^f^.* 6 n^*™*™*** areas in the reference and searched images can be obtained in previ- 
irr^rwed mismatching can be greatly reduced. That is. the reliability of the stereo matching can be greatly 

iuJH^^ "J* re ! erence data Wocks ' the searched areas, and the searched data blocks can be suitably 
be irn^ro^d positional information of the projected points, the reliability of the stereo matching can further 

e S 6 '' the re,erence data h*** 5 a "d the searched data blocks can be dynamically varied according to the 
searched positions, the reliability can furthermore be improved. 9 

Further, since the above described stereo matching can be made on the images having no projected characteristic 
™ tt / ! ms - « rro " eous detection on account of the characteristic patterns does not occur. Further, since the image having 
time^siUs m^ C sS rnS ^ ^ *** °' *" datebase - tne ori 9 inal imaae ™ *>* ^red at the same 

Further, according to the above described embodiment, since an image with characteristic patterns projected ther- 
eon and an .mage wrth them not projected thereon are used, the need for the work to glue a mark onto the subject can 
be eliminated and hence H becomes possible to make measurement on a subject, onto which a mark cannot be glued 
Thus, by the capability of forming an image having only characteristic pattern information by obtaining the differ- 
ence between an image with characteristic patterns and an image without them, the processes of detection of charac- 
teristic pattern positions -orientation -stereo model formation -three-dimensional measurement can be performed 
without requmng manual work but automatically and precisely. Namely, the need for manual work for orientation and 
three-dimensional measurement which has been troublesome and requiring skill can be eliminated and all the proc- 
esses can be automatically performed with increased reliability. 

Furthermore, since it is not necessary to firmly secure the camera to the pan tilt head but highly precise three- 
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T(m,.n,) - Template Image 
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R(a.b): Residual 
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xg=isx*f(x,y)}/£'(*.y) 
(xg. yg) : Coordinates of Center of Gravity 
t(x. y) : Concentration at Coordinates (x. y) 

yg= {xy*r(x,y))/xf(x,y) 
(xg. yg) : Coordinates of Center of Gravity 



f(x, 



y) : Concentration at Coordinates (x. y) 



Eq. 4 
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Xo, YovZor.CocxdimtesofCerrterofProie^nonLeftlmage 
Xo, Yo, Zo, : Coo^nates of Center o, Project on Right .mage 

Xl . Yl Z, : imaged Coordinates in Lett Image 

X 2 . Y 2 . Z 2 : image's Coordinates in Right Image 
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Eq. 6 

,VX /cos*, 0 sin^fcos^ -si**, ^ V 



Eq-7 . „ nW:c x /r 
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2,1 \0 sina> : coso) 5 



X m = MXi- x oi> + X ° 1 
v v Z Model's Coordinates 
40 • t,.t 2 : Parameters 

V =1 /2x<t 1 (V 1 -Vo,H'a(V,Vo 2 H^>'o 2 > 



Eq.8 



Eq.9 



v v z m : Model's Coordinates 
ti. ■ Parameters 
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said approximate position measuring portion (31), at least either setting up of the reference data blocks (T) in 
the reference image or setting up of the searched areas (R) and setting up of the searched data blocks (U) in 
the searched image. 

5 8. An image measuring apparatus according to claim 7, characterized in that 

said pair of images (51 , 52) include a characteristic pattern image of which positional information is previously 
known, and 

said approximate position measuring portion (31) is adapted, in accordance with the position of the character- 
io istic pattern image in the reference image and the positional information of the characteristic pattern image in 

the searched image, to approximately obtain the positional information of the subject (O) for measurement in 
each of the pair of images (51 , 52). 

9. An image measuring apparatus according to claim 8. characterized in that said data setting portion (32) is adapted 
is to set up the range of the searched area (R) in the searched image in accordance with the position of the charac- 
teristic pattern image in the searched image. 

10. An image measuring apparatus according to claim 8, characterized in that said data setting portion (32) is adapted 
to set up the range of the searched area (R) in the searched image in accordance with its relationship with the post- 
20 tion of the characteristic pattern image and the position of the searched area (R) in the searched image or with the 

position of the characteristic pattern image and the position of the reference data block (1) in the reference image. 

1 1 . An image measuring apparatus according to claim 8, characterized in that said data setting portion (32) is adapted 
to set up the magnitude of the range of the searched area (R) in the searched image in accordance with its rela- 

25 tionship with the position of the characteristic pattern image and the position of the searched area (R) in the 
searched image or with the position of the characteristic pattern image and the position of the reference data block 
(T) in the reference image. 

12. An image measuring apparatus according to claim 11, characterized in that said data setting portion (32) is 
30 adapted to set up in the searched image the range of the searched area (R) having a larger width or area in accord- 
ance whether the characteristic pattern image and the searched area (R) in the searched image, or the character- 
istic pattern image and the reference data block (T) in the reference image, are more distant from each other. 

1 3. An image measuring apparatus according to any of claims 9-10, characterized in that said data setting portion (32) 
35 is adapted to set up a plurality of searched areas (R) differing in size. 

14. An image measuring apparatus according to claim 8, characterized in that said data setting portion (32) is adapted 
to set up the reference data block (T) in the reference image in accordance with the position of the characteristic 
pattern image in the reference image. 

40 

1 5. An image measuring apparatus according to claim 8, characterized in that said data setting portion (32) is adapted 
to set up the magnitude of the reference data block (T) in the reference image in accordance with the position of 
the characteristic pattern image and the position of the reference data block (T) in the reference image. 

An image measuring apparatus according to claim 8, characterized in that said data setting portion (32) is adapted 
to set up in the reference image the reference data block (T) larger in height or width according as the position of 
the characteristic pattern image and the position of the reference data block (T) in the reference image are more 
distant from each other. 

An image measuring apparatus according to any of daims 14-16, characterized in that said data setting portion 
(32) is adapted to set up a plurality of reference data blocks (T) differing in size in accordance with the characteristic 
pattern image in the reference image. 
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FIG. 12 
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FIG. 15 
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